Deciphering Big Data

This module explores the diversity of different data types, sources, and methods of data collection, as well as the process of Data Wrangling.

Learning Objectives

I have learned how to :

  • Identify and manage challenges, security issues and risks, limitations, and opportunities in data wrangling.
  • Critically analyze data wrangling problems and determine appropriate methodologies, tools, and techniques (involving preparing, cleaning, exploring, creating, optimizing, and evaluating big data) to solve them.
  • Design, develop, and evaluate solutions for processing datasets and solving complex problems in various environments using relevant programming paradigms.
  • Systematically develop and implement the skills required to be an effective member of a development team in a virtual professional environment, adopting real-life perspectives on team roles and organization.

Artefacts and Reflections

Artefacts.

Find all my artifacts demonstrating development throughout the module, and more specifically the discussions and any activities that highlight my understanding of the challenges, security issues, risks, limitations, and opportunities in data wrangling, team meeting notes, and peer and tutor feedback here

Individual Reflection

This is my reflection piece on:

  • My knowledge of the different data extraction, exploration, cleaning, and modeling techniques I have covered in this module.
  • My contributions to the team activities.
  • My experience as a member of a development team.
  • The impact on my professional/personal developmentLearn more

Professional Skills Matrix and Action Plan

I have gained and improved several valuable skills from this module.

  • Data Collection and Cleaning Techniques.
  • Programming Skills (SQL).
  • Working effectively with a team.
  • Normalising data in a table.
  • Modelling and building a database using MySQL Workbench.

I can apply these skills at my workplace in creating and managing a database. However, I still need to improve upon my Web scraping abilities as it is an essential skill for a Data Scientist.